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System for selecting, accessing, and viewing portions of an information stream(s) using a 
television companion device ^ 



(57) A television companion device (TCD) is a de- 
vice comprising a communication transceiver capable 
of receiving a signal trom a television set, the signal hav- 
ing one or more types of information split from a broad- 
cast signal received by the television set and an output 
that presents one or more segments of one or more of 
the types of information. This device enables the per- 
sonal viewing of information selected specifically for the 
individual. This information can be different than and/or 



unrelated to that displayed on the television. The infor- 
mation displayed cnl^h individual TCD may be video 
clips or video prograjgfi, audio clips or audio programs, 
data, graphical images, still images, and/or animations! 
The device may alsqcpmprise an input that sends one 
or more messages ipfbugh the communication trans- 
ceiver to the television, thereby allowing the viewer to 
send requests for information to the television or send 
messages to other television companion devices. 
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Description 

Field of the invention 

[0001 ] This invention relates to the area of digital tel- 
evisions. More specifically, this invention relates to se- 
lecting and accessing different portions of an informa- 
tion stream from a digital television. ' 



Background of the invention 



[0002] Analog'* television in' the United States and 
elsewhere* in the world is one of the most effective'** 
means of communication and entertainment, yet it has 
undergone relatively little advancement in recent years 
in comparison to other electronic technologies. Its prin- 
cipal capability has been to distribute individual chan- 
nels of moving images and 'sound' to millions of viewers 
around the world. It has hot, however, exploited the phe- 
nomenal technical advances of the past twenty-five 
years nor the wealth of information now available elec-'' 
tronically. We are now on the verge, however, of ena- ' 
bling these advances with the introduction of digital tel- 
evision. * ~ ^ 3 i'-e, ;.•:.:-*•".-•■.'* 

[0003] Recently, webTV enabled the browsing of web ' 
pages and the display of them on a traditional television 
set. The television can be used for web browsing or pro- 
gram viewing, but cannot be used for both operations 
simultaneously: -In 'both cases, the viewing is'done. in a : 
communal manner, i.e. all viewers get the same infor- 
mation. Recently, some broadcasters have coordinated/ 
the simultaneous broadcasting of a particular program" 
and the serving of associated information on the inter- 
net. Once again, this is done' in a/priricipally-commOriar* 
environment. 

[0004] Soon, digital televlsibn wilf enable the distribu- 
tion of auxiliary^infbrrfiation with a video broadcast. With 
this technology, a video signal can be digitized, packf 
etized and : multiplexed 1 with one : or more audio signals 
and one or 'more dafa' chanriels. The data channels' can v 
be closely 'related 'to '-the associated video or may be 
completely unrelated. These multiplexed signals are' ri L ; 
f erred to as'a program. 'Additionally; many programs can . 
be multiplexed into a 1 single ( transport Stream.- The re- 
sulting signal can be -distributed to television viewers' 
through either a'*terrestrial broadcast, a CATV network 
or other network- Once received, the television can de- 
multiplex the' video, jaudlb and auxiliary information and ; 
output it on the TVs screen and/or speakers. 
[0005] Today, selection of the program content to be 
viewed on a television is ; accomplished by 'a channel se- 
lector. It selects the VHF or UHF channel which thfe tel- 
evision willturie to and can often be' control led by a re- 
mote control device. In this capacity,' the selector selects 
one video signal and one~or more channels of audio. In 
addition, today's 1 VCRs^can be programmed to select a 
particular criannel at a scheduled time'in the future. Tel- 
evisions do not typically have this feature:' 
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[0006] A television also uses many of the various 
types of wireless technologies currently, available (TV 
remote controls, broadcast signals, etc.). The. broadcast 
signal is an example of a signal modulated to create .a 
radio frequency signal which can be transmitted through 
the air the television receives and demodulates this 
signal to create the original baseband signal. Television 
remote controls often modulate a signal on an infrared 
light to transmit information through the air. In this case, 
"the television receives and demodulates the signal to 
create the original baseband signal. Cable TV is an ex- 
' ample of signals which have been modulated to a radio 
" frequency and then JrapsporteoVover a coaxiaj cable. 
Once again, a television demodulates the signal to cre- 
ate the original ; baseband signal, jn.sorne cases, cable 
television networks mod u late. a Jaser or light emitting di- 
ode to transport" the signal. over a fibre optic cable. In { 
this case^'a photo .detector is used lo enable the recre- 
ation of the J original broadcast signal. :( ~ - 
[0007J Originaljy,. a television was defined as a device 
capable of receiylng* an analog broadcast' signal over a 
VHF or UHF chahh eland sejectively.displaying one vid- 
eo signal together^ with Ifts associated audio, signal. To r 
day, the signal received can.corheJrpm a cable/TV" net-, 
work, "a terrestriaF broadcast, a video tape recorder or . 
camera, a computer network or.other videp ; source ; As, 
the television me/ges with otherdeyices, such as per- 
sonal computers, ,if will/equire an even broader defini- 
tion. |n this instance, "a more appropriate definition is a 
device which receives a signal consisting of one or more . 
video channels and one or more types of information 
streams including .audio,, data,, text .arid, graph ics : and 
^ which outputs on e,pr .more of- these streams. . . ~ : 
- [0008] Thejsjgnals.. output ,on a television .today, can, 
include video, audio and data, the audio output is typi- 
cally amplified. by an audio amplifier and then sent to a 
pair of headphones or ohe pr more.speakers.~The video 
jslriost often displayed pn'a cathode ray. tube, but it may 
also be displayed by a projection system or on a flat pan- 
el display. This latter technology Jnc I udes, the relatively, 
hew thin-film iransistor displays. Text characters are al-; 
so often overjayed on .the video.-to display, the time of 
day, selected channel, closed caption text or^other in- 
formation. Typically, one video stream, one text st ream 
and multiple audio streams are output. - 
[0009] Many televisions today contain processors of 
different types: video processors, digital signal proces- 
sors, etc. Tejevisions-are beginning to rnerge with per- 
sonal computers and contain subsystems that look like 
PCs. This may include a processor IC, static ram, dy- 
, namic ram, Interrupt handlers and other peripheral de- 
vices normally associated with a computer. Thus, many 
of the applications which. PC users have enjoyed^will be 
available in the television system, including tl^e capabil- 
ity to exchange messages and play computer games. , 
[001 0] Dfgital.teievision provides for the simultaneous 
broadcast of both a television program and associated 
data. The data can be displayed with or overlayed on 
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the broadcast video. This technology, however, indis- 
criminately forces all viewers to see the same informa- 
tion and only the information chosen by the broadcaster. 
Thus, while one viewer of a football game on television 
may be interested irrstatistics and another viewer is in- 
terested in the scores of other games, both viewers are 
forced to view the same information. In addition, only 
information chosen by the* broadcaster may be ac- 
cessed by the viewer ' 
[0011] The Internet/alternatively, provides access to 
vast amounts of information: While Web browsers such 
as WebTV can provide access to this inforniat ion, 'they I 
do not provide access to information dlstrib ; uted;Wrth thef 
video, broadcast* if that information was nof obt^ihed 
from the internet They also provide a pririci|ally com- : 
munal viewing experience?^ 

In other wordsi ail people m thteVoom viewing toe' ™ 
see; the entlre : arWou^ shown >: 6n : "the ■ 

screen whether that information comesffom tKe brbad-^ 
caster or the Internet. Lf '- i.^ . - * >~. 
[0012]" Unfortunately; neither v 6f tri 
vides custdmizedr-mdivlduaf Viewihgi of the auxili^irv! : 
fofmatiorPav^ilableT The prior a^sysiems ^f^6 f^j] io 
provide sirnulta^ the digital' televi- 

sion- broadcast and ihe Internet. "W^riiofe'^^n^- t * 
te ^jnjnent and ecbnb'mic value of television broa ! &clist- ' 
ing^is not exploited by'th'e prioPart/ 4 ' - : ' v ^ ' ° r ' :: K - r = 
[001 3] It ; is an object bf the present irive~ritibn~ to pr^ " 
vide a technique which alleviates tHe-abovVdrawbackl 

Summary of the Invention • % r - v $ ' ^ 

t°fl4] _According4o the present Invention we ^provide 1 
a :]l!?^ ision c °mpahT6n device ; "(Teb)^compTising: J a'"' 
communication receiver ca 

from a television -^etptne signal having one dr"rtib% r 
types of information split from -a-'bVbadcast ' r sighaTfie- q ' 
cejyed by^he" televlsibh ; set and an outrJuVthat^reser& 9 
one or more ■segments of bne : br *more of 'the" type's of 
information:' : ' r <' J ' % '"^ ''V' — \ 
[QP15] Also according tb the p 

vide a television companion' device^f CD) ^cbrfiprising: ' 
a commuriicatroh in fertac« capable ; bf receiving; a signal 
trom^a tetevisib'n^ 

types of information;* a sefect'orlhat ielects^dne brrrtbre r 45 
segments from one or more of the types 6f inforrhatbn; v " 
and an output that presenis one "ormdre ot the seg-' ' " 
ments. - \ . ■ = .■; :v. 

[001 6] A television companion device ? (TCD)* is' a de- 
vice comprising a communication transceiver capable z so 
of receiving a signal from a television set, the 1 
ing one or more types of information split f rbm a broad- " : 
cast signaL'received by the television set andean output 
that presents one or. more segments of one of more of :: ' 
the types of information: This device'ehabtes the per-" ss 
sonal viewing of ^formation-selected specrficaffy for the* ' 
individual. This^ information can" be* ; diff erent than and/br 
unrelated to that displayed oh the television. The ihfor- 



. mation displayed on each individual TCD may be video 
clips or video programs, audio clips or audio programs, 
data, graphical images, still images, and/or animations' 
. The device may also comprise an input that sends one 
£ or more messages through the communication trans- 
ceiver to.the television, thereby allowing the viewer to 
. . , send requests for information to the television or send 
messages to other television companion devices. 
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Brief Description of the Drawings 



„ J0017] .The foregoing and other objects, aspects and 
^dvantages.wilJ be better understood from the following - 
detailed description of. p r^ferrad- embodiments ipf the in- 

, .Mention wrth,refe ; renQe 1) to the'drawings.that are, include 
the following; . ^ ... .,7'^. '. , r 

Figure /i is , a . block diagram,^ 

sion - s ^ ern using ajeleyjsion companion device;: : 

:i figure Af^ft block diagram^" an improved televi- 
sion; Z \ ' . 7 7. 7 
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;0 Figure 3 is a block diagram of a preferred television 
. , companion deyjee;, , . r . ; . _ - , , , . . ^ . ri : , . , 

? : F, 9 u ^ ; 4 ; is c a : blc^|ccUag^ pf L a Prof il^Sy bsysj-em j.^- 

r :; : i F '9 ur | % is'eLflow chartjqf asel&ct^ap^ , 

Figure G 6,is an. example b!, 3 prof tie configured-with^ 

Ibetaiied Description oj [ the. Invention ! J ^ 
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' [0018] With .the adyent of. (digital television, broadcast- 

-. l9& m of 9nd'audio..Tiney wjll soonrh^v^\the ability 1 
!rf '.' t f^ transm ^^V-?^ 1 ? P!b9rarn' s of ^udii'^deoV^ata and 
^ptjier inforrnatibn.^th^ . 
"new capabilities,. a. pe^w television : sy^jenn. is needed . to 
. facilitate the . vje^ing jftis in^ ..'1 " 

[001 9] Figure, i. jsTajioqk diagram of-a npveJ teJevisioa r . 
. system 101 wjibvarjou^ 
companion device (TCD)^2^ 
r television iOP.presents content, to, tfje general .viewing 
audience 65 andcommMnicate^s with a nurnber-of te(e-, ~ 
vision companion device^ 1 20 via a communicatK>n link .. 
0j 9 « 121 )- 'n one prefeVred.embpd^ 
'are hagdheW devices. used 7to present individuaJ, cus- 
tomized infbrrnatjpri to viewers. In, alternative embbdi- 
ments, e.g. in a tejeconferehcingioom or in a bar^the 
TCDs 120 can be. mounted, into a.terminal, e.g^ a table 
or desk, provided to each viewer 65- The goal here-is to . 
identify, select ajid view information streams ot interest 
tp the general viewing. audience 65 (television) and for 
each individual 65 (holder/user of at CD) Thiswill'help 
the'viewers (e.g. multiple numbers of ,65) find and view 
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the streams .which have the highest entertainment or in- ' For instance, using this embodiment, a parent could limit 
formational value to both the general audience 65s and information (stream 185) access by a child using the 
the individual viewer 65. TCD 120. In an alternative embodiment, the XV 100 

[0020] The .information streams 185 are audio (e.g., sends all streams 185 to all TCDs 120. .Here only. the 

English and/or Spanish commentary of a soccer game), 5 TCD 1 20 Selector 1 24 selects streams, of interest 1 85 
video (e.g., the moving images of the soccer game); da- to display to each particular user 65 on the respective 
ta (e.g. statistics on the players), graphic (e.g. graphs TCD output (125-127). One application for this embod- 
of the statistics), still image(e.g., portraitsof the players) iment would be a public setting, e.g. a bar, with a large 

or animation streams (e.g.- computer generated videos- number of TCD users 655, each interested in specific sta- 
diagramming and explaining a play in the game) broad- 'io tistics selected from a large number of ^statistical 
cast over a television network. In a preferred embodi- ' " ■ streams 185 about one or more games being viewed 
ment, these information streams, or streams, typifcally 1 ' communally on the TV 100. In still another preferred em- 
185, comprise a plurality of byte packets; typically -188, * * bodiment, both the TV lOOand.oneormoreof the TCDs 
as specified in the MPEG-2 specification. In a preferred" * - 120 does the select ion.. In this case, the TV selects sub- 
embodiment, they are time multiplexed together to ere- - ~is 'sets of streams^ 1 85 to transmit to one pr more subsets 
ate a Program Stream; typically 186. : One or "more" Pro- of TCDs 120. Then the TO Ds r 120 will perform an addi- 
gram Streams.186 can then be multiplexed tdgether to - tional selection of, the incoming streams 185 to select, 
create a Transport Stream (TS) 19Tthat is transriiitted '* * the exact streams of interest for each particularyiewer 
from the broadcaster. (A -well known P roc/ram Identifier ' 65. In this embodiment, the TV 1 00 selects basketball 
(PI D) is used to-identify"each of the information streams * 20 game 1 streams 185 and baseball game streams. 185 
185 within the TS 191.) In Digital Television, the Trans- * from all the sports streams, 185, received by the. TV 100. 
port Stream 1-91 is broadcast to the viewer-65 v on a VH F Then each individual TCD .1 20 user 65 selects-which of 
or UHF channel. ' - . : • "J" ? " "the basketball/baseb'al! games and/or statistics he wish- 1 

[0021] As:stated above, some-bf the important oper- es to view: ~\ ' ^ 7 

ations are the identification, selection "and presentation 2s [0023] The communication link between the.teleyision , 
of the information streams 1 85 'to the audience" (65s). • " "100 and the TCD 120 can utilize a. number of different 
Although the television 100 must perform the selection 'technologies. In some implementations pf the improved 
for the general viewing audience 65s,' the streams of in- ' ' television system, the. TV Transmitter 1 08 and TCD Re- 
Jerest 1 85 <to -the' individual viewers 65 can be selected; * ' eeiver 128 (the communication link) can be radio-fre- 
by the television 1 00 and/or the TCDs T20~ As described 30 quency transmitters and receivers (with respective TV- 
below, the select ion process can be executed automat- ! "antenna 109 and TCD antenna 121), fibre.optic trans: 
icaNy or can require'manuai intervention by the Viewer fl mitters and receivers pr .coaxial drivers ancl. receivers. . 
65. Once selected, the streams -1 85 for the" general view- " ' ".In the former case, the signal wilLbe transm itted through ( 
ing audience-65s are output on the television 100: The ; V. 'the air. as "in the'ease pi the radioJrequency broadcast, 
streams 185 selectedforthe' individual viewers 65s ? are * . -35 described above, Jn the latter cases,. either-a fibre.qptic- 
transmitted by the television 1 00 to the TCDs 1 20 where ' " ' 6r coaxial cable will transport the Comm Signal 1 40 from ■ 
they are output oh a TCD output (1 25 : 1 27), e.g.- an op- ' ' 1 "Jthe Television 1 00 tp the,TCD 1 20. These technologies 
tional display device 026^127) and/or output ph an op- ' " are well known. " ^ . , ! v , * , > - : -i . " ; 

tional audio device ( 1 25) ■ ■ ~ J ■■ .~ r • ; - v ^ [0024] Figure 2 is a block diagram of the novel TV 1 00 

[0022] The : information' streams 185 which are to be "* 40 and Figure ^is a block diagram of the Television Corn- 
output on either the television 1 00 or TCD i 20 must first ' " " pan ion Device "(TCD) l2b showing more detail. The TV 
be identified and selected. -A preferred embodiment of 100 contains a known Broadcast Antenna, 101 usedlo. 
this system; includes a novel Selector (1 04 and 1 24 be- " receive a known terrestrial Broadcast Signal 1 50. in one., 
low) which- -provides fbr ! the" intelligent selection of * preferred embodiment, the Broadcast, Signal 150 is a- 
streams 185 fora television 100 and/or TCDs 120. Since 4S digital signal which has been RF modulated using a 
either the television 5 100 and/or the TCD 1 20 may per- known 8 Vestigial Side Band (VSB) modulator and then 
form the selection, the selector (1 04/1 24) can be used ' transmitted In the .6 Mhz bandwidth of a traditional VHF 
in eitheror both devices (100/120). In one preferred em- or UHF channel. Typically,, each VHF or UHF channel 
bodiment, the television 100 and the TCD 120 contain ' will contain one digital signal of up to approximately 20 
a selector (104/124).- Thus, the television 100 has the so ' Mbps. In an alternative embodiment, there is no anten- 
option of broadcasting all 'received streams 185 ! to all na; the signal is received over a coaxial cable or other 
the TCDs 120i a subset of the streams 185 to all the transmission technology. This digital signal comprises 
TCDs 120, a subset of the streams 185 to a subset of djfferent types of time-multiplexed information streams 
the TCDs 120, or only selected streams of interest 185 1B5 including any one or more of the following:, one or 

to particular TCDs 120. In one preferred embodiment, 55 more video streams, one or more audio streams (chan- 
e.g. during a-particulaV time of day, only the TV Selector hels) and one or more .data, streams (channels).-. Each 
1 04 selects the selected streams 1 85* and selects the ~ of these types of streams 1 85 can be further divided into 
subset of TCDs 120 to receive these selected streams. segments (see Figure 4) where each segment compris- 
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es a beginning, middle and end of any of the following: 
a videoclip or program, an audio clip or program and a 
data segment.JThe streams and segments are time mul- 

tiplexed together to create the digital signaM02A. These 

streams and segments are well known. 

[0025] After being received by the Broadcast Antenna 

101 , the signal 150 is demodulated by the TV Receiver 

102. This will recreate 102A the original broadcast dig- 
ital signal comprising time multiplexed video streams; 
audio streams, and/or data streams 185. In high-end tel- 
evisions, theTV Receiver 102 will be capable of demod- 
ulating multiple signals, thereby allowing the Television 
100 to simultaneously select information streams^ 185 
from different broadcast chanhels:Tbe TV Demultipfex- 
or 103 will demultiplex the video, audio, and data 
streams 185 from the'' digital signaM02A into individual " 
segments of video, audio and/or data 109A. Integrated 
circuits are currently available which will multiplex and' 
demultiplex the transport streams' '191 into; a small 
number of- individual information streams 18%!. They uti- 
lize the FHD of eabh : stf^^ 

stream 185 is audio, video or ddrtai:;Sc^ 
of the improved television system TOO Will require a be^ 
multiplexor" 1 03 Which can : output 'a large number of 
streams 1 85 simultaneously. This is done by cascading 
knowing Demultiplexer^ r \ 
[0026] Once' derrtultiplSxe'd; the' TV Selector 104;'tf 
used, will then select ^ne^r hnore strear^(s) 185 to be 7 
optionally output on the TV 100 itself and to be senYto. 
one or more'TCDs 12b (through a novel TV Mumplexof 
113 (below), TVtransmitteVlO^ 

tion output; efg., Antenna 109. The TV' Selector ; 1 04 'is '* 
a specialized device which is capable 'of sele^ing one " 
or more information-stream's 185 from a multitude of in- 
put information streams'-1 85 received frdhi the TV tie- r: 
multiplexor *YG3.The TV Selector 104 is described^in de- L " 
tail below. °' t ;; ' . 
[0027] As the streams 185 are receiveaVthe optional 
TV Processor 1 12 will search the data within the sjrekrns., 
185 to locate important informal 
a video segment, etc. This information can then be dis- : 
played by the TV Processor 112 on the TV Screen 107 * 
to inform viewers 65 of the existence of other information 
streams 185 which they may choose to select. The ~lV 
Processor 112 will generate menus which the viewer 65 
can have displayed on either the TV Screen 107 or the 
TCD Screen 127. If the 1 menu is to be displayed orrthe* 
TCD Screen 127, the TV Processor 127 will send the'" 
menu to the (TCD) Processor 1 34.This send operation 
is described later. As described below, the Menu Pointer 
130 can be used to highlight an item in the menu and 
thereby select an information stream 185 for output oh - 
either the TV 100 or TCD 120; ' -'■ : ' ' 

[0028] The data, audio and/or video streams 185 se- 
lected for the Television 1 00 will be sent to the TV Video 
Output 106 for display on theTV Screen 107 (optional). " 
In this embodiment, an MPEG-2 video decompression " 
IC is used to decompress the video stream arid create 



10 



. 15 



20 



36 



35 



40. 



45 



50 



55 



an analog video signal which can be easily displayed 
using known video output devices. The TV Screen 1 07 
can be a CRT, a flat panel display, a projection display, 
a thin film transistor (TFT) p^nel or any other type of 
graphical display. The selected audio channel(s) will.be 
optionally sent to the,known TV Audio Output- 105 to be 
output on TV speakers or headphones. The~TV Receiv- 
er 1 02, TV Demultiplexor 1 03, TV Audio Output 1 05, TV 
Video Output 106, and TV Screen 107 are well known/ 
[0029] The TV .Selector 1 04 itself is used ina new way 
to provide, s.elected streams and/or segments 409A to 
the TV 106,and/or,tha TCDs 120v The SelectoM 04 will 
f . receive demultiplexed informations streams 185 from the 
- TV Demultiplexor .103 on separate weJI known .data 
, busses. As the streams 185 are ;receiyed, the. Selector 
104 will b.e , instructed by the TV Processor 11 2^to select: 
;; . particular,.«treams to be^output; on its -separate^ output 
. data busses. In an^lternative embodiment,' the,streams 
-485 are ^ejected by a TV Profile; Subsystem : 1-10 .(be-? . 
low)., §ome QUhese output busies wilte.end<the selected. 
... information ; strea^ns 1 09A tp.the TVcMultiplexor 1 T13 for:. 
o transmission tot^ 

.send the selected information streams 109 A loathe a 
;j known TV Audio £>utRut.1 Q5 and/or the TVcVideo Output. 
; . 106 for output on ? the 7y : 10p..The me.thcxi for actually,,; 
t selecting the ; streams 109A oHnte rest is -described.be- 

[0030] Tbe^ Multiplexor 143 will multiplex tnevse-v- 
lepted informatipn sireams : -1<)9A from t(qetTVLProcessor-: 

■J! 2 w ^ n in t?.™ ati ^ 
;,104 into Tf^s|^ :j Strea 

transmitted tp : the TCDs 1 £0. -The,transport;Stream?1 9 to. 
..is a well krjoyvn fpijnat and pan be ; fpund : in4hetMPEQT- 
£ JransporL specif ication.document.^ >, 
th.e TV MulljpJexc^ 

- deader fiejd.tp. the Transpqd-3tream -1 9 V. packets ^BB^i 

. ln one^ r prefew:ed c e^ta^jn^eot; -each/TGB; as- - ? 

^.sjgned an address that is used to determine wfiich:Qf - 
Jh«? packets 1 $8 a(e ( to ; be received A twq bytfi header 
ts attached to .the beginning of each papket; 188. -The^ r, 
first byte is ; ^e address. cif tb5TCD : 120^d i tr^epond, 7'. 
byte is a Unear JRedu^ , h 
well known and is used to detect, bit, errors wMch; may:-,, 

; occur in the address/the (TCD) pemultip[exo,r.~i 23 v .wNI 3 * 
only demultiplex andjputput the- packet 188; if the Adr 

. . dress of the. packet matches the address assigned to; 1 
the TCD 120. In an alternative embodiment, the address 
is inserted , in the user -fields, defined in the, MPEG-2 
Transport Specification and is' utilized in .the same way. - 

t In an alternative ernbodim<9nt, the Demultiplexer 1 23 de- 
multiplexes all Information, Streams 185 and the (TCD) 
Selector 124 compares the address of the Packet 1,88 
to the address assigned to the TQD to determine if the; 
stream. 185 can be„selected. , ' .,, . , . 
[0031] In another alternative embodiment, the PID .of. - - 

. each Information Stream 1 85 is used to determine which , : 

TCD(s) 120 should receive Jhe : Information Stream 185; - 
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If the stream 1 85 was selected by the TV 1 00 tor a par- 
ticular TCD 120, then the TV Processor 112 will send a 
message to'the'(TCD) Processor 1 34 containing the PI D 
of the streams 185 which the TCD 120 should receive. 
The Processor 1 34 will then instruct the Selector 1 24 to 
select the stream 185 which has that particular PID. If 
the stream 185 was selected by the TCD 120, then the 
Processor 1 34 will instruct the Selector 1 24 to select the 
stream 185 which has that particular' PID. 
[0032] These streams/segments 1 09A which are des- 
tined for the TCDs 1 20 will be broadcast via the known 
TV Transmitter 108 through the known TV output"; e.g? 
Antenna 109: In someimplementatibns of the improved 
television system 1 01 , the TV Transmitter 1 08 and TCD 
Receiver128 will be Infrared transmitters and receivers, 
fibre optic transmitters and receivers or coaxial drivers 
and receivers. In the former case, the signal will be 
transmitted through the air as in the case of the radjo 
frequency broadcast described above. In the latter cas- 
es, either af ibre optic or coaxial cabje will transport the' 
Communication (Comm) Signal 1 40 from the Television/. 
100 to the TCD 120. In some implementations, bi-direc- v 
tional communications is needed between the TV 100 
and the TCD 120. In this case, the TV 100 will comprise ; 
a TV TCD Receiver 114 and the TCD 120 will comprise ' 
a Transmitter 1 35 utilising ahy known communication 1 
technology, e. g. one of the technologies 'outlined above. 
[0033] In one embodiment, each strearn or segment 
1 09A transmitted" in this manner will contain an address 
290 which identifies the TCD(s) 120 which it is destined 
for. The address 290 can identify all of the f CDs 120 in 
the system, a subset of them or a particular TCD 120. * 
If the transmission -'does not include ah "address 290, 
then the television lodwiil broadcast the information 
streams "T85 to' all the TCDs'120.1n one'preferred em- 
bodiment, the television^ 100 wiil not be able to select 
streams 185 for individualTCDs 120. The TCDs 120 will : 
have to either output all the informatiph streams 185 
transmitted by the television or it will have to use its own 
Selector i'24toselect the streams 185 Which willbeout- ' 
put. In alternative embodiments, the PID of the informa- 
tion stream 185 can 'be used to identify streams 185 
which the TV'lbO has selected for the TCD 120. 
[0034] Each TCD 120 Will utilize its known Antenna 
121 to receive the CorrimSignaM 40 which is transmit- 
ted from the TV 100. Trie received signal 140 will be 
demodulated by the Receiver 1 28 to recreate the Trans- 
port Stream 1 91 transmitted from the TV 100. In some 
embodiments where the signal is not modulated (e.g. 
some coax link technologies), the signal does not have 
to be demodulated by the Receiver 128. A (TCD) De-. 
multiplexor 123 will demultiplex the received signal into 
individual video; audio and/or data streams and/or seg- 
ments 123A. In some embodiments, the Demultiplexer 
123 is a novel demultiplexer which can utilize the Ad r 
dress Header described above to determine if the infor- 
mation stream 185 transmitted from the TV 100 should 
be received by the TCD 120. It does this by comparing 
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its assigned Address to the Address in the Address 
Header which is appended to each packet 188 ip the 
Transport Stream 1 91 . , 
[0035] Once demultiplexed, the (TCD) Selector 124 
will select which streams 185 will be output by the de- 
vice. The selected data and video streams 124A will be 
sent to a (TCD) output, e.g. a Video Output 126fordis- . 
play on a (TCD) Screen 1 27. The (TCD) Screen 1 27 can 
be a CRT, aflat panel display, a thin film transistor (TFT) 
panel or any'type of graphical display The selected au-. 
1 dio channel(s) 124A also will, be sent to a TCD output, 
e.g. the Audio Output 125 to be output on headphones 
. or speakers and/or the Video Output' 126 after passing 
./through 1 a speech recognition system. As described 
, above, these are known devices. Note that in alternative 
embodiments, , one or more of the TCDs 120 would have ' 
' only an audio output 125, e.g." if a first set of TCD 120 
users 65 receives audio in a first language while a sec- 
ond set of TCD 1 20 users 65 watching the same TV 1.00 
. display receives audio in a second language. In another 
alternative embodiment, one or more of the TCDs 120 
would only have^a Video Output 126, e.g. where r the 
TCD 1 20 users' 65 are only interested in text information 
that supplements ^and/or augments the. TV 100 video 
'that Is common to all the, TCD 1 20 users 65. ' . 
1 [0036] " ' The. Selector 124 "enables each individual user 
1 65 of a TCD 1 20. to select parts and subparts (segments) 
.of information streams .(transport stream t .streams, and/ 
or segment)' 185 .transmitted by the Television tOQ. Se- 
lection of the streams (segmentsX (10^ A and/or -124A). 
to be output by the TCD *120 is performed by the Selector 
J i 24 and/or the TV selector 104 r which can be controlled 
in many alternative ways. For example, a Menu Pointer 
'1 30 can be used to select an item from a menu which 
appears on either the TV Screen r 1 07 or the TCD Screen 
;1 27. As described abpyeVtHe TV Processor^ i 2 will gen- 
" erate menus 'with* the 'names of various streams -which, 
[the user ; 6$"can choose 'from. Once selected, the TCD,, 
Processor 1$4 will instruct the 'Selector. 124 ,to output 
the selected stream(s) 185. Alternatively, a message 
can be sent from the TCD'Processor 1 34 via the Trans^* 
mitter 1 28 to the TV 1 00 instructing the TV Selector 1 04. 
to select a particular stream(s)-109A for.the TCD .120. 
[0037] The optional Keyboard 129 can also be used 
to identify a stream 1 85 to be output. The viewer 65 sim- 
ply enters the name of the stream 185. As in the case 
of the Menu, Pointer 130, the TCD 120 and/or the TV 
M 00 will execute the selectipn 1 24 of the streams/seg- 
ments. 

[0038] Finally, an optional Profile Subsystem 1 31 and/ 
or an optional TV Profile Subsystem 110 can be config- 
ured to use the selector (124. and/or 104) to select 

. streams of interest 185 to.the viewer 65. In this case, 
the Selector 1 24 (TV Selector 1 04) will be automatically 
directed by the Profile Subsystem 131 (TV Profile Sub- 

... system 110) to obtain these streams 185. 
[0039] In one preferred .embodiment, the Selector 
(104, 124) is controlled by a Profile Subsystem 131 (TV 
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Profile Subsystem 110) which contains information of in- 
terest to the viewer 65. This information can include 
broad categories of interest (News, sports, weather), 
types of. information (statistics, scores, financial) or spe- 
cific information (person, place, things). The. informa- 
tion, formally known as Profile Items (typically 605 be- 
low), is stored in a Profile Database 220. See Figure 4 
below. EaclrPrdfile ItemBOS contains a category, a key- 
word, and/or keyphrase which is compared ^Identifiers 
(201 A, 202A, and 203A in' Figure 4 below) which identify 
the received streams 185. Identifiers (201 A, 202A, and. 
203A) can be keywords or keyph rases wrthih the infor- 
mation data streams 185 or can be generated by the 
Information Processor (111 and/or 134) described be- 
low. 

[0040] Figure 6 shows an exarriple of a Profile 600 in 
a Profile Subsystem (110 and/or/ 134)1 In this em.bodi-. 
ment, the Profile 600 is a database* of a plurality of 
records, typically 605; each containing a category field' 
615, a Type field 620, and one or rnore 'fields with key- 
words and/or phrases 630. In this example;, the general 
audience (television viewers) 65s are interested in any 
stream 185 of information* related to Fires (entry TV 4). 
In the category : of sports, the users 65s are interested 
in information on any sports person named Pippen (en- 
try TV 1) 630, any hockey scores (entry TV 2) 6^0 and 
any football' scores 630 of the Atlanta team(s) (entry TV ' 
3) 630. The viewer of TCD 120 #ns interested in world 
news 615 for Washington DC 630;ahd Iraq 630 (entries 
TCD 1-3 and TCD 1-2) and anj political news on Clinton 
630 (entry" TCD t-1); The viewer bfTCD 120/ #1 2 is in- 
terested in any events related to' festivals 620 (entry; 
TCD J-4)V any weather 615 forecast 620 for New York : 
630 (entry TCD 1 2-1 ) and any information related to Fi- 
nance 615 (entry; TCD 12-2)* Iri this embodiment, any 
combination of fieldscan be' used to Identify an area of 
interest/ A Boolean AND operation is performed on the ' 
profile items 605" when more than one field (615, &20; 1 
630) has an entry.* As streams 185. are Received 128 
and Demultiplexed 1 23, the Profile Subsystem i 3i and/', 
or TV Profile Subsystem 110 will search for matches be- T " 
tween the received information streams 185 and the" 
profile items 605 in the Profile Database 220. The TV 
Profile Database 220 contains Profiles 600 for the' TV ' 
100 itself and, optionally, for one or more of the Tcbs 
120. The profiles 600 for the TV 100 comprises profile 
items 605 of interest to the general television viewing 
audience 65. The profiles 600 for the TCDs comprise 
profile items 605 of interest to each of the individual 
viewers 65 in the system. In addition, profile items 605 
for a group of individual viewers 65s can be described. 
The Profile Item Comparator 221 will perform the actual 
comparison as described below. 
[0041] In one preferred embodiment, a match of all 
fields ( 615, 620, and 630) in the profile item 605 has to 
occur before there is a match. When a match is found, 
the selector (104 and/or 124) will be instructed to select 
the identified stream(s) or segment(s) (109A and/or^ 
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124A) by using the PID to identify the.stream 185. As 
described above, the TV 100 will transmit the selected 
stream(s) : and/or segments 109A. to the appropriate 
TCDs 120. In some embodiments, the TCD 120^11 
comprise a Profile Subsystem 1 31 which is the same as 
the TV Profile Subsystem 110 but which contains a pro- 
file 600. for the Tpp 1 20 only. "' 

[0042] , The pptional TV Information Processor 111 will 
process the incoming video/audio.and/or data streams 
1 85 in search. of information relevant to the viewers. For 
. instance,.. image processing can.be used, to identify. a 
highlight of a, football game. If a viewer were interested 
„ in such an.event, the . TV Profile .Subsystem would, be. 
configured to indicate this. When the TV Information 
Processor.. ,11,1 identified the event, it. would output an. 
. Identifier, (?P1 A^ 202A, 203A) which will be compared 
,by the Profile hem Comparator "221 to Profile Items 6Q5- 
in the Profile Database 220. If a match is found, the.ProV 
file Item pomparatpr 221 will cause.the TV Selector 104 
.to choose, the appropriate stream(s) 1 85_and transmit 
Jhem to jhe appropriate TCD. 1 20. As described above,, 
the TCD. 120 would then output the stream(s) 185 for. 
the viewer 65,. Alternatively, the Information Processpr 
132 located in ttje TCD i20 can process, the incoming/ 
. stream(s) 18£.and identify. stream(s) of jnterest 185 to* 
this. particular viewer 65.. In \h\s, case, the Selector, 124 !.. 
would be instructed to select the. appropriate stream(s) 

;i85. " \ ^ \; : ./ \; \ 7 ;,,! ' 

[0043] ' The TV Information Processor 1U and Jnfpr 
mation l^rpcessor 132 can utilize various ^technologies 
Xo process, and . identify streams of interest '1 85. to, the 
Viewers 65. This-is shpwnjn Figure 4., The Image Prpq-i' 
essor 202, can be; usecfto identify a'person,.place,.thing^ 
. action, or.. event which can be compared to. the profile^ 
items 605 ip the prpfiles 600. Forexarnple, the IBM Que-p 
ry by Image Content .technology ban identify a particular ^ ' 
. colour or texturejn an image.. Similarly, the Audio Proc- 
essor 201 will use speech recognition to generated 
. searchable transcript for jiey word searching, audio . 
processing.tp determine the type, of audio including any 
one or more of the following: speech, music, noise and 
sounds and speaker identification processing to deter- . . 
mine the identity of a particular speaker. J BM s ViaA/oice "\ 
product, for instance; can generate text from the spoken 
word. Finally, the text Processor 203. can bemused .to , 
reduce the incoming data' information .into a searchable 
hit list of .one or more words. The Identifiers (201A, 
202A, 203A) generated by these processors (201, 202,. 
203) are sent to the Profile Item Comparator 221 to be 
compared to items in the Profile Database. 220. .Each , 
Identifier (201 A, 202A, 203A) is compared to each entry 
. a in the profile. 600. If all the entries in a record.605 are 
found in the set of Identifiers (20.1 A, 202A, 203A) gen- 
erated for a particular Information Stream 1 85 Jhen that 
Information Stream 185 is selected and sent to the TV 
100 or TCD 120 identified in the label of the .entry 605, 
A match in this comparison will result in an output on the 
Selector Control 231. signal which will instruct the TV Se- 
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lector 104 or Selector 124 to select the appropriate 
stream(s) 185. In an alternative embodiment, the Infor- 
mation Stream 185 will be selected if a subset of the 
Identifiers (201 A, 202A, 203A) for the Information 
Stream 1 85 matches any arbitrary subset of the fields ( 
615, 620, and 630) in the profile item 605. The technol- 
ogies utilized in the TV Information Processor 111 are 
all known. 

[0044] As an example of the improved television sys- 
tem 101, assume three television stations are broad- 
casting on different VHF channels: channels 3, 4 arid 9. L 
In this scenario, channel 3 is broadcasting a football 
game complete with highlights (NFL) and scoresfrom 
other games in a data stream (SCORES). It is also trans- 
mitting news updates on a separate data channel 
(NEWSUP). Channel 4 is broadcasting a news program' 
(NEWS), a news magazine-show (NEWSMAG) and a - 
documentary on U. S. Presidents (DOC). Channel 9 is 
broadcasting a movie inhighrdefinition format (MOVIE). 
The profile 600 is configured as in the exarhple above. : ■ 
There are.twoTGDs 1 20 receiving- broadcasts' from a * 
television 100. Eacrv.TCD 120 has alTof the optional - 
components described above. Figure 5 is a flowchart of 
the processes which occur in the improved television 
system 101:. . . . 1 . : • ■ ~ > . \ 
[0045] Figure 5 is at low chartof one preferred selec- 
tion process 500 that is used to performed by the systenrv 
101 . This process 500 is now explained by way of ex- 
ample. As the broadcasts are received, the TV Receiver 
1 02 demodulates 501 the three broadcast signals to rec- 
reate the original digital Transport Stream signals* 191 
The TV Demultiplexer 103 will then demultiplex 502 the 
signals to recreate the following information streams: 
NFL, SCORES, NEWSUP, NEWS, NEWSMAG, DOC, 
and MOVIE. All of these streams 185 will be sent to the 
Selector 104 for selection 503. Simultaneously, the TV 
Information Processor 111 is processing 51 2-each of the 
incoming streams 185 and creating identifiers (201 A, 
202A, 203A) which are used by the Profile Comparator 
221 to determine 51 3 which streams 185 are to be out- 
put (105, 1.06, 125; and -126); These items are sent to " 
the TV Profile Subsystem 110'for use in the selection 
process. The TV Processor 112 is also parsing 510 -the' 
data streams .185 to search for categories 615, types 
620, and/or keywords and keyphrases 630 which are 
indicative of the content of each information stream 1 85. ■ 
In addition, the % TV Processor 1 12 will also create menus' : 
511 of the categories 61 5, types 620, and/or keywords 
and keyphrases 630 identified and will display them on 
the Television 100 and TCDs 120 to allow the viewers 
to select streams of interest 109A and 124Ar- 
[0046] In this example, the TV Information -Processor 
111 has generated the Identifier (201 A, 202A, 203A) 
FIRE from the news program (NEWS) after it has gen- 
erated the' Identifier (201 A, 202A, 203A) ATLANTA 
FOOTBALL from the NFL program (NFL). The TV Proc- 
essor 1 1 2 has s also discovered the Identifier : (20 T A, * 
202A, 203A) CLINTON in the documentary- program 
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(DOC) and the Identifiers (201 A, 202A, 203A) EVENTS 
FESTIVAL from the movie program (MOVIE). All of 
these Identifiers (201 A, 202A, 203A) keywords are sent 
to the TV Profile Item Comparator 221. 
[0047] The TV Profile Subsystem 1 1 0 is continuously 
comparing the received Identifiers (201 A, 202A, 203A) 
to the profile items 605 in the TV Profile Database 220. 
After finding a match between the Identifier (201 A, 
202A, 203A) ATLANTA FOOTBALL and Profile 600 en- 
try TV 3 (620, 630), the TV Profile Subsystem 110 will 
instruct the TV Selector i 04 to select 503 the football 
program (NFL) for the TV 100. Later, when the FIRE 
Identifier (201 A, 202A, 203A) is generated; the TV Proc- 
essor 112 will generate a menu 511 to be, displayed on 
the TV Screen 107. This will alertUhe TV 100 viewers 
that a fire is being referred to oh the news program 
(NEWS) and will allow them to switch to this program. 
In addition, the TV Profile Subsystem 110 will instruct 
•the TV Selector 104 to" 1 select 503 the documentary 
(DOC) for TCD 1 20 #1; andWe movieYMO S(\ EJjbn chan- 
nel 4 for TCD 12b #12f thestreams ; selected for the 
TCDs 1 20 are sent to the TV Multiplexor 116 where the* 
addresses of each of the TCDs 1 20 are appended to the 
streams. The TV Multiplexor i 1 6 will multiplex 504 these 
streams destined for the TCDs 120 together with the 
menus generated 511 by the TV Processor 112. The 
Transport Stream 191 which is generated is then trans- 
mitted 505 to the TCDs 1 20 via the TV Transmitter 108 
and the TV Antenna 109. . L 

[0048] As'described previously, the TCDs 120 willre- 
ceive 506 the Comm Signal 140 via the Antenna 121 
and will demodulate 506 ihe signal'to create the original 
Transport Stream* 191. The DeWUItiplexor 123 will de- 
multiplex 507 theTransport Stre'am;i40 into'ih'e individ- 
ual informatibh streams .135 "arid will compare the ad- 
dress of each stream with the address of the TCD 1 20/ 
When a match is'found, the Demultiplexbr 123 will for- 
ward the stream to the Selector 124] The Selectors 124 
in TCDs 120 #1 and #12 will send the selected 508 .in- 
formation stream(s) 1 85 to the appropriate device (1 25, 
126) for output 509. Additionally, the Information Proc-/ 
essor 132 and Processor 134 in the'TCD 120 may also" 
generate 515 Identifiers (201 A, 202A, 203A) on thejn- 
formation streams; 185 received from the TV 100. SirjK 
ilar to the operation described above, the Profile Sub/ 
system 1 31 will compare Identifiers (201 A, 202A, 203A)' 
and will instruct 51 6 the Selector 1 24 to select 508 one 
or more of the information streams 185 for output 509 
on the TCD 1 20 if a stream(s) 1 85 of interest to the view- 
er 65 have been found. 

[0049] Other capabilities enabled by'the improved tel- 
evision system include the ability to exchange informa- 
tion between TCDs 120. In this case, messages typed 
on the Keyboard 1 29 will be input to the Processor 1 34. 
The Processor 1 34 will format the message, embed the 
address of the TCD(s) 120 which should receive the 
message and transmit the message via the Transmitter 
128. This will allow individuals 65 viewing a television 
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broadcast. to^xchange messages with other viewers 65 - 6. 
while viewing a television broadcast. 
[0050] . In addition, the Processor 134 can run appli- 
cations such as games via the Processor 134. The 7. 
broadcaster. is alsp.able to provide auxiliary information -5 
which can allow the viewer to play along with a game 
show being broadcast. This personalized version of the 8. 
game would allow the viewer 65 to guess answers be- 
fore the results were revealed on the show. 
[0051] The improved TV^IOO will also provide access io 
to the internet to obtain supplemental information. A 9. 
viewer 65 can send an internet request by either typing / ,.' , ~. 
the URL on the . Keyboard 129 qr, by using the ; Menu . : 
Pointer 130 to select a URL displayed on either the TV \ 
Screen 1.p7 ( or the TCD Screen'127. The Processor^ 34 . ,;5 10. 
will create a request. message and transmit it to r the TV > - 1 
100. The TV 100 will receive the message as described . .. " . J /. 
above and ^lJhstruct.the Ipternet Interface 115,to re T " - 
trievethe web pages jrom^^ 

Once obtained; the Internet Interface., 1 15 wilt forward. 20 • 
the pages tp the TV processor ,112, The TV Processor r '[ ,Z 
112 will eitherjrahsmit the^pages to ; the.TCD^126 for " \ — 
output or wilt display them.;ohjhe TV Screen 107,' The" t ',, 
processes^fpr retrieving jhfor^ \ ;. v ' \\ 

are well known! "' 7 V ' . "', ' * :; . ' 
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Claims 



1 . A television companion device (TCD) cprnprising: 30. 

a . ^ m -7 1 4H i p^ ti 9n YepeiyjE^capa^^ receiving J 
a signal from atelevisipn^^ ' 
one or rnbne. types of information .splitlrpm^a '-' " 
b C9^^cast signal r^ 

and , : ' ' '[ / 'I 

an output ( triat'p^septs ? pne or .mpVe, segmeoti' ,. \ 

of Jnfbrmation. *V^' 

2. A device,: as in ciairn 1. Jurther comprising an input ^ 
that s^rids one or more m ess^gesjh tough the com- 
municatipn transceiver to the televisipn. 
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3. 



A device, as. in claihi..2^where the messages are 
any one or more of the following: a, request for a 
control for a TV selector^ a request for a web brpwsr - 
er request, a requesfto a web bro w^er to visit a„web, 
site, and an acknowledgment. 

A device, as in any preceding claim, further. com- 
prising an input that sends one or more messages 
through the communication transmitter to 'another 
TCD. • 

A device, as in any preceding claim, further com- 
prising a selector that selects one or more of,, the 
segments to be presented op the output. ' . " 
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A device, as in claim 5, where the output is different 
than a TV output on. the TV. 

A device, as in claim 5, further comprising a selector 
input that controls the selector. - 

A device, as in claim 5, where the selector selects - 
one or more of the segments based on one or more 
addresses received with the signal. 

A device, as in any preceding claim, further.com- 
prising-a. demultiplexer , that demultiplexs one/ or 
more of the segments from the signal. > 

A deyice, : as in.eJairr* 9,-that demultiplexes: one^or 
more of: the^segments based on one or more, acf- 
dresses received with the . signal , - . - ? 

A device, as Jn. any preceding ' claim; where the 
typeset, information include anyoneror.more of.the.o 
following; avideochannejf an audio channel, a data r.c 
channel, one or more graphical images, and one or 
more animated images. / , / 0 . - l.- ;.r^ 

A device, as in any preceding claim, where the seg-. 
ments include any one or more of the following:, an 
audio- clip, a r video segment- a. still image* and ar: 
stream of A ext., : _ - Jt s - x -. ryi v : . •-, ., 

A device, as jnany^p receding claim, where the corrir ;^ 
munication. link-is any one e^ mpr.e of thej following: * 
an infra red Jink, ,-■ - e »;., - ? , J r -.^::. 

a radio Jiqk, ^fibre ppfc link, andia cpaxiaHink.: • < 

Adevice. as jn any : preceding ciairn, where the.outr ^ 
put includes any one or mors of the. following: a vid-r « 
eo output,an .audio output,, and a, text output: :^ - : .. 

A television companion ;deyipe v (TCD) comprising: , ' 

a communication interface capable of receiving 
a S'9naHrGm a television set, the signal. having » 
one or more types of information; vt 
a selector that selects r pne. or more segments-; ^ 
. from one or more of the types of information^ 
andr • - . - .., ...... .. r., . ^ ^ . 

an output that presents oneor more of the s.eg- 
ments v . ■ .- ..... ... , 



16. A device, as in claim 15, further comprising a de-, 
v.:, • ; r multiplexor that demultiplexes the signal into one or 

more of the types of information. . . > ^ 

17. A device, as in claim 15, where the selector further 
ss - comprising a Profile Subsystem which contains a 

profile of profile items in a. database of informatioa 
of interestto a viewer and which will contrpl.selec- 
; ; tion of one or more of the segments if the;segments 
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contain one or more profile items. 

18. A device, as in claim 17, further comprising a Proc- 
essor Subsystem having one or more processors ; 
which process any one or more of the following seg- ' $ 
ments before selecting the segments: a video seg- 
ment, an audio segment and data segment. ~* . r " - - 

19. A device, as in claim *18, where one or more audio 1, \ 
segments are processed by using speech recogni : l - - 
tion to generate a searchable transcript for key word . - 
searching. '. '\ 

20. A device, as in claim 1 8, that uses audio processing 

to determine the type of audio including any one or *5 
more of the following; speech, music, noise and 
sounds and using speaker identification processing 
to determine the identity of a particular speaker. 

21. A device, as in claim 17, where,onepr more- video * ■ 
segments are procesaed^by using^ image. process- ; 

ing to identify a searchable;personi place, thing, ac- * \ 
tion, or event. - \ - v 

22. A device, as in c'aim 17, Where one ormore data 2$ ; 
segments are processed' by Using text processing j > 

to generate a' searchable hit list of Tope or more : L. — 
words. ' ' 



23. A device, as3nl claim 18, ,where the Processor Sub- -30 
system generates identifiers from the processed 
segments, the identifiers being used by the Profile 
Subsystem to control the se lection. V " ~ - 1~ - - — 

24. A device, as in claim 18, where the Processor Sub^ ,;? 5 ' 
system generates identifiers from the processed 
segments, the identifiers being used to notify a user 

of the existence of, one or more of the segments. 

25. A device, as in claim 15, where the selector has a 40 
selector input that is any one or more of the follow- 
ing: mouse, keyboard, screen, and pointer. 
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